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by 
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SUMMARY 

A  detailed  examination  is  made  of  a  simple  auto-regressive 
model,  so  as  to  determine  the  optimal  sampling  rates  for  parameter 
identification.  It  is  3hown  that  sampling  at  approximately  six 
times  the  frequency  of  interest  has  a  number  of  optimal  properties. 
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"yin  time  series  analysis  a  particular  model  for  a  linear  system 
is  an  auto-regression  model.  Auto-regression  models  are  particularly  well 
suited  to  structural  linear  systems  which  have  been  persistently  excited 
by  white  noise.  The  white  noise  is  assumed  to  be  unmeasurable  and  it  is 
assumed  that  there  is  no  measurement  noise. 


The  variability  of  the  results  obtained  in  practice  tends  to 
depend  on  the  sampling  rates  used. 


This  memo  examines  in  detail  the  asymptotic  convariance  matrix 
for  estimates  of  the  damping  rate  and  frequency  for  a  fixed  length  of 
record  and  variable  sampling  rates  in  a  linear  system  which  is  completely 
described,  in  continuous  time,  by  a  single  second  order  differential 
equation.  It  is  shown  that  the  selection  of  sampling  rate  plays  an 
extremely  important  role  in  the  quality  of  the  estimates.  '■  J  : 
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2.  THE  MODEL 


Let  Xg.  be  the  measured  response  of  a  linear  system  at  time  t  and 
let  be  a  stationary  white-noise  process.  Then  the  auto-regression 
model  to  be  studied  is  (Ref.  1). 


xt  *  Vt-i  *  Vt-j  -  £t  ,2-,) 


where  a1  =  -2  exp(-aT)coswT 
a2  =  exp(-2aT) 

a  -  decay  rate  of  the  corresponding  continuous  time  process 
u  *  frequency  of  the  corresponding  continuous  time  process  and 


T  »  time  between  samples 


3.  PARAMETER  ESTIMATES 

A  A 

The  least  squares  estimates  of  a^Ca..)  and  a2(a_)  minimise  the 
N  2 

expression  I(x„  ♦  a  x  +  a0x  where  N  is  the  number  of  independent 

j  t  i  t-i  d 

estimates  of  the  nosie. 

The  normal  equations  which  result  from  this  process  are 


£xtxt-1  +  Vx  t-1  *  a2Zxt-1Xt-2=  0  (3,1) 

IXtxt-2  +  VXt-1Xt-2  +  VX  t-2  =  0  (3.2) 

Asymptotically  equations  (3-0  and  (3.2)  become 

Vo  +  Vi  *  pi  a  0  (3‘3) 

A  A 

a,p.  *  a„p_  +  p_  =  0  ( 3 - 4 ) 


Zxtxt-2  +  Vxt-1Xt-2  +  VX  t-2  =  0 


Vo  +  Vi  *  pi  a  0 


Vi  *  Vo  +  p2  =  ° 


where  pk  is  the  auto  correlation  of  lag  k. 

Equations  (3-3)  and  (3.4)  are  the  Yule-Walker  equations  and  may 
be  solved  using  very  efficient  algorithms  for  higher  order  systems.  In 
our  example  we  have 


(3-5) 


A- 

a 

A 

=  - 

P0  P1 

-  1 

P1 

_a2 

P1  p0 

P2_ 

The  convariance  matrix  of  this  estimator  is 


E  (a  -  a) (a  -  a) ' 
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where  a  =  [a^ ,  a^] 
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and  a 2  -  E(et2) 

The  parameters  a  depend  however  on  the  sampling  rate  as  well  as 
the  system  parameters  a,  u. 

It  is  necessary  to  calculate  the  asymptotic  convariance  matrix 
of  a  and  u.  Noting  that 

a2  -  exp(-2aT) 

a1  -  -2  exp(-oT)coso)T  (3.9a) 


and 


6a1  -  2Tcos(u)T)exp(-aT)5a 


♦  2Texp(-aT)sin«T  6u> 


(3.9b) 


5a2  -  -2T  exp(-2aT)6a 


we  obtain 


53, 

_  —  y 

a, 

6a 

m  l 

2a2  0 

6b> 

(3.10) 


Using  standard  statistical  theory  it  follows  that  the  asymptotic 
convariance  of  a,u>  is  given  by 
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a1  ,  2a2 

2a  ^  0 

a,(1-a2) 

<1-a‘> 

-/i»a2-a  *  0 

(3.11) 

and  the  asymptotic  covariance  matrix  (Q)  is 


(1-a  ) 

r\  ^ 

0 

(1  +  a2)  a1 

Q  ’  2  2  2 

Ni  Ha2(4a2-a^) 

-2a2  a, 

a1  1  +  a2 

(3.12) 


As  NT  -  tf  -  total  time  available  for  observations  and  defining 
6  -  u)T  and  G  -  a/w  it  follows  that 


a1  -  -2exp(-Ge)cose  (3-13) 
a2  =>  exp(-2G0)  (3- I'D 

The  convariance  matrix  can  now  be  expressed  as  a  function  of  G 
and  e,  except  for  a  constant  multiplier  w/t^..  The  convariance  matrix  can 
be  scaled  up  or  down  according  to  the  value  of  w/t^.. 

It  should  be  noted  that  as  t^.  •  the  convariance  matrix  goes  to 
zero  for  any  fixed  values  or  G  and  0.  This  means  that  for  a  sufficiently 
long  record  time  a  and  w  are  essentially  determined  without  error, 
provided  that  there  is  no  aliasing  in  u>.  However  this  is  only  true 
numerically  if  the  computer  were  to  work  with  infinite  word  lengths.  For 
a  finite  record  length  it  will  be  shown  that  the  sampling  rate  is 
important . 
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4.  MEASURES  OF  PERFORMANCE 

Various  measures  of  performance  will  now  be  studied.  These 
measures  reflect  the  fact  that  the  convariance  matrix  must  be  small  in 
some  sense.  The  actual  value  of  these  measures  at  any  particular  sampling 
rate  is  unimportant  due  to  the  factor  w/t^,  rather  it  is  the  minimum  value 
of  the  measure  as  a  function  of  0  that  is  sought.  The  matrix  Q  is  given 
by  (3.12). 

These  measures  are 

2 

(i)  the  determinant  of  the  covariance  matrix  Q-j  i®22_^12 

(ii)  the  maximum  eigenvalue  of  the  covariance  matrix  A  (Q) 

*n<i  x 

(iii)  the  variance  of  the  damping  estimate  (Q^). 

(iv)  the  variance  of  the  frequency  estimate  (Q22). 

The  first  measure  is  called  the  generalised  variance  by 
statisticians.  The  second  measure  finds  the  linear  combination  with  the 
most  uncertainty.  The  third  and  fourth  measures  are  appropriate  if  the 
parameter  of  interest  was  purely  damping  or  frequency  respectively. 

The  various  measures  are  plotted  as  a  function  of  6 
for  0  <  e  <  7T  and  G  «  .01,  .10,  .50,  1.0  and  the  optimal  value 
of  o  (ITHETA,  in  degrees)  is  printed  for  each  measure  above  each  graph. 

In  all  measures  that  involve  eigenvalues,  plots  of  log  (maximum 
eigenvalue)  and  log  (minimum  eigenvalue)  versus  0  are  given.  Here  it 
should  be  noted  that  0  -  0  corresponds  to  sampling  infinitely  fast 
and  0  =  180°  corresponds  to  sampling  at  the  NYQUIST  rate. 

All  calculations  were  done  extremely  carefully  as  the  condition 
number  of  the  matrix  varied  from  1  to  50,000  and  upwards.  This  meant  that 
differences  between  numbers  of  a  similar  size  were  always  avoided. 

The  vertical  scale  in  all  graphs  is  artibrary  due  to  the 
presence  of  w/t^  in  the  convariance  matrix. 


5.  DISCUSSION 


Figure  1  shows  that  the  generalised  variance  or  determinant  is  a 
monotonically  increasing  function  of  e  (This  can  be  shown  analytically 
for  all  G).  Here  it  should  be  noted  that  the  value  of  ZTHETA  should  be 
zero  (ie  0°)  rather  than  1°  since  0°  requires  a  special  evaluation  of  the 
determinant  which  was  not  done. 

The  generalised  variance  is  an  inappropriate  measure  as  the 
determinant  is  the  product  of  two  eigenvalues.  The  possibility  exists 
that  the  determinant  is  small  but  that  the  matrix  is  very  ill- 
conditioned.  Indeed  Figure  2  shows  that  this  actually  occurs.  The  top 
curve  is  the  logarithm  of  the  maximum  eigenvalue  and  the  bottom  curve  is 
the  logarithm  of  the  minimum  eigenvalue. 

The  maximum  eigenvalue  is  minimised  for  lightly  damped  modes  at 
about  9  »  60°  which  correspnds  to  sampling  at  3ix  times  the  frequency  of 
interest . 

It  should  be  noted  that  the  condition  number  of  the  matrix  is 
also  at  its  optimum  for  this  sampling  rate. 

For  some  value  of  G  (0.t<G<.5)  the  optimal  sampling  rate  occurs 
at  0  »  0°  with  a  corresponding  increase  in  ill-conditioning.  This  implies 
that  for  modes  which  are  heavily  damped  the  sampling  rate  should  be  as 
high  as  possible  consistent  with  the  precision  of  the  calculations. 

Figure  3  illustrates  the  fact  that  the  variance  of  the  damping 
is  a  monotonic  increasing  function  of  e. 

This  function  is  K 

a3  substitution  into  (3*12)  will  show,  where  K  is  an  arbitrary  constant. 

Figure  H  also  resembles  a  raonotonic  function;  however  this  is 
misleading  due  to  the  large  values  obtained  near  e  -  180°. 


exp(AGe)-1 

e 
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6.  CONCLUSION 

The  optimal  sampling  rate  has  been  examined  for  a  very  simple 
model  involving  an  autoregressive  model.  The  optimal  sampling  rate  for 
lightly  damped  modes  is  six  times  the  frequency  of  interest.  At  this 
sampling  rate  the  convariance  matrix  has  a  condition  number  approximately 
equal  to  one. 

Throughout  this  work  it  has  been  assumed  that  the  sampling  rate 
has  to  be  the  same  as  the  sampling  rate  used  in  the  model.  The  model, 
however,  could  use  a  sampling  rate  much  lower  than  the  rate  at  which  data 
arrive  with  no  loss  of  information. 

It  is  clear  that  in  a  more  complicated  system  the  optimal 
sampling  rates  will  depend  on  the  pole  positions  of  the  continuous  time 
system  in  a  complex  manner  and  that  different  sampling  rates  need  to  be 
used  for  different  modes. 
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1C.  Abstract 
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